Implementation of an Automatic Sign Language Lexical Annotation Framework based on Propositional Dynamic Logic

摘要

In this paper, we present the implementation of an automatic Sign Language(SL) sign annotation framework based on a formal logic, the PropositionalDynamic Logic (PDL). Our system relies heavily on the use of a specific variantof PDL, the Propositional Dynamic Logic for Sign Language (PDLSL), which letsus describe SL signs as formulae and corpora videos as labeled transitionsystems (LTSs). Here, we intend to show how a generic annotation system can beconstructed upon these underlying theoretical principles, regardless of thetracking technologies available or the input format of corpora. With this inmind, we generated a development framework that adapts the system to specificuse cases. Furthermore, we present some results obtained by our applicationwhen adapted to one distinct case, 2D corpora analysis with pre-processedtracking information. We also present some insights on how such a technologycan be used to analyze 3D real-time data, captured with a depth device.